Gradient descent

Results: 277



#Item
61Convex optimization / Mathematical optimization / Stochastic optimization / Machine learning / Gradient descent / Subgradient method / Stochastic gradient descent / Proximal gradient methods for learning / Perceptron / BroydenFletcherGoldfarbShanno algorithm / Online machine learning / Loss functions for classification

Adaptive Subgradient Methods Adaptive Subgradient Methods for Online Learning and Stochastic Optimization∗ John Duchi

Add to Reading List

Source URL: stanford.edu

Language: English - Date: 2014-09-05 13:17:02
62Estimation theory / Statistical theory / Parametric model / Loss function / Fisher information / Expectationmaximization algorithm / Divergence / Likelihood function / Gradient descent

Energetic Natural Gradient Descent

Add to Reading List

Source URL: psthomas.com

Language: English - Date: 2016-05-26 17:40:03
63Artificial neural networks / Sigmoid function / Artificial neuron / Parameter / Function / Gradient descent / Backpropagation / Multilayer perceptron / Activation function / Theano / Default argument / Artificial intelligence

Theano Tutorial Theano is a software package which allows you to write symbolic code and compile it onto different architectures (in particular, CPU and GPU). It was developed by machine learning researchers at the Univ

Add to Reading List

Source URL: colinraffel.com

Language: English - Date: 2015-12-30 23:12:51
64

Case Study 1: Estimating Click Probabilities Intro Logistic Regression Gradient Descent Machine Learning/Statistics for Big Data

Add to Reading List

Source URL: courses.cs.washington.edu

Language: English - Date: 2013-01-08 01:56:27
    65Artificial neural networks / Applied mathematics / Artificial intelligence / Machine learning / Neuroevolution / Evolutionary algorithm / Deep learning / Backpropagation / Stochastic gradient descent / HyperNEAT / Genetic algorithm / Multilayer perceptron

    Simple Evolutionary Optimization Can Rival Stochastic Gradient Descent in Neural Networks In: Proceedings of the Genetic and Evolutionary Computation Conference (GECCONew York, NY: ACM Nominated for Best Paper Aw

    Add to Reading List

    Source URL: eplex.cs.ucf.edu

    Language: English - Date: 2016-04-28 14:32:32
    66

    Supplementary Materials: Accelerated Stochastic Gradient Descent for Minimizing Finite Sums Atsushi Nitanda Tokyo Institute of Technology and NTT DATA Mathematical Systems Inc. Tokyo, Japan

    Add to Reading List

    Source URL: jmlr.org

    Language: English - Date: 2016-06-06 23:29:35
      67Artificial neural networks / Applied mathematics / Machine learning / Cybernetics / Recurrent neural network / Deep learning / Long short-term memory / Stochastic gradient descent / Convolutional neural network / Rectifier / Backpropagation / Gradient descent

      ADVANCES IN OPTIMIZING RECURRENT NETWORKS Yoshua Bengio, Nicolas Boulanger-Lewandowski and Razvan Pascanu arXiv:1212.0901v2 [cs.LG] 14 DecU. Montreal

      Add to Reading List

      Source URL: arxiv.org

      Language: English - Date: 2012-12-16 20:30:23
      68Mathematics / Numerical analysis / Algebra / Computational statistics / Stochastic optimization / Linear filters / Numerical linear algebra / Convex optimization / Stochastic gradient descent / Gradient descent / Artificial neural network / Mathematical optimization

      Topmoumoute online natural gradient algorithm Nicolas Le Roux University of Montreal Pierre-Antoine Manzagol

      Add to Reading List

      Source URL: nicolas.le-roux.name

      Language: English - Date: 2011-05-05 09:32:05
      69

      Gradient Descent Objective Function Some differentiable function f : Rn → R. Gradient Descent Start with some x0, i = 0 and learning rate λ repeat

      Add to Reading List

      Source URL: alex.smola.org

      Language: English - Date: 2013-09-09 02:28:42
        70Operations research / Econometrics / Convex optimization / Numerical linear algebra / Estimation theory / Preconditioner / Support vector machine / Linear regression / Gradient descent / Regression analysis / Stochastic gradient descent / Linear programming

        Weighted SGD for ?𝓅 Regression with Randomized Preconditioning

        Add to Reading List

        Source URL: www.stat.berkeley.edu

        Language: English - Date: 2015-12-28 18:07:07
        UPDATE